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ABSTRACT 


A branch-and-bound algorithm, which finds the optimal route through 
n nodes when a different cost matrix occurs after each arc in the sequence 
is traversed, is presented. The route may begin at any node and must 
pass through each of the n nodes exactly once. The objective is to mini- 
mize total cost in traversing (n-1) arcs of the route. The cost of traversing 
each arc is 2 , which is a function of the distance between nodes i and j 
and a function of the ee position in the sequence of arcs forming the route. 

The algorithm is presented in step-by-step detail and illustrated 
by flow chart and examples. A modification for symmetric 7 improves 
the efficiency of the algorithm. 

A trade-off between computation time and storage requirements may 
be accomplished by alternate branching policies. Suboptimal solutions 


may be obtained with reduced computation. 
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I. INTRODUCTION 


The algorithm presented in this thesis uses the branch-and-bound 
technique to find the optimal route through n nodes, which passes through 
each node exactly once, while any two of the nodes may be chosen for 
the start and finish of the route. The objective is to minimize total cost 
in traversing the (n-1) arcs of the route. The cost of traversing each arc 
if at which is a function of the distance between nodes i and j and a 
function of the an position in the sequence of arcs forming the route. 

The routing problem that is described and solved is closely re- 
lated to the traveling salesman problem. It differs in that the route is 
not closed and that a different cost matrix occurs after each arc in the 
sequence is traversed. 

Since the branch-and-bound methodology is used successfully by 
Little, et al, [Ref. 1] for solving the traveling salesman problem and 
is recommended by Bellmore and Nemhauser [Ref. 2] for medium-sized 
traveling salesman problems of 13 to 70 nodes, it is expected that the 
routing algorithm which is based on branch~-and-bound concepts will 
provide an efficient solution to the sequence dependent routing problem 
and will serve as an alternative to dynamic programming with its large 
computer storage requirements. 

As will be seen, the algorithm successfully solves any of the 


general class of sequence dependent routing problems for which the 


matrices of all possible costs for traversing arcs can be provided at each 


stage in the sequence of arcs which form a complete route. 


It. THE BRANCH-AND-BOUND METHOD 


A. GENERAL CHARACTERISTICS 

Virtually all programming techniques, including linear programming, 
dynamic programming, backtrack programming [Ref. 3], and branch-and- 
bound, contrive to find a vector, a = —— : x), which optimizes 
an objective function £ (X) - By some search rule elements are selected 
from the product space A XXX. : xX of n "selection spaces" with xX an 
plement of X. Hopefully the searching procedure will be considerably 
more efficient than the trial of all possible vectors in the product space. 

The branch-and-bound search procedure consists of selectively 
partitioning the product space and then computing bounds on the objective 
function for each subset of the partition without enumerating all vectors 
in the subset. For the case in which £ (X) is to be minimized, the branch- 
and-bound technique first constructs a lower bound on £ (X) for all possible 
vectors in the product space. In the next step of the branch-and-bound 
procedure, the set of all possible solution vectors is partitioned and a 
tightened lower bound on £ (X) for each subspace of the product space is 
Calculated. 

As an example of these two steps, consider the problem of mini- 
mizing f(x, (Ro ree Xe) equal to the sum of the elements of X where 
each of the elements of X must be taken from a different row and column 


of a 5x5 matrix. For the first step, compute the sum of the 5 least 


elements in the matrix as the lower bound for all possible solution 


vectors. For the second step, select an element of the matrix to be xy: 
The set of solution vectors is now partitioned into the set of vectors 
which have xy - a , for some particular i and j, and the complement of 
that set. The lower bounds must be calculated for each of the two subsets 
of the partition. 

In general for the branch-and-bound search procedure, further parti- 


tions, "branching", and tightened bounds are made on the subset which 


has the least lower bound. After sufficient partitions some subset will 


* * * 
contain but a single vector (x, Ko reee x) and the bound of this subset 
* * * * 
will be the value of the objective function z = f(x, Ronee x) . “Any 


* 
of the subsets which have lower bounds greater than z cannot contain 
the optimal solution and may be disregarded in the search for the optimal 
* 
vector. If z is less than or equal to all the lower bounds on other sub- 


* * * * 
Sets: (X51 X ,e-e,X,) is an Optimal solution. Ifz is greater thammuae 


3 
lower bound for some subset of the partitioned selection space, that 
subset must be further partitioned until the process of tightening the 


lower bound proves no optimal solution vectors are present in that sub- 


set, or until an optimal solution vector is isolated. 


B. BRANCH -AND-BOUND NOTATION 
The following notation is used in the literature with respect to 


the branch-and-bound method [Refs. 1, 5, and 6]. 


x a subset of all feasible solution vectors 


Né a subset of X 


<| 


the complement of Y with respect to X 

W (x) a bound on the objective function for all possible 
solution vectors in X 

The subsets are uSually represented as the nodes in a tree of nodes 


and branches with each node labeled by its associated bound. 


Figures similar to this one give the technique its name of branch- 


and-bound. 


IIL. THE ALGORTIR 


A. BRANCH-AND-BOUND NOTATION FOR THE ROUTING PROBLEM 

The basic method of the algorithm is to break up the set of all 
possible routes through n nodes into smaller and smaller subsets and to 
calculate for each of the subsets a lower bound on the cost of the best 
route in that subset. The bounds obtained are used as guides for the 
selection of further partitions into smaller subsets. The algorithm 
eventually isolates one or more subsets which are complete routes 
whose costs are less than or equal to the lower bounds for all other 
subsets. Such routes are optimal. 

Arc (i,j) has the usual definition from network theory [Ref. 4] --- 
i.e. , a directed path from node ito node j. The term "leg" refers to 
one of the sequence of arcs which form a complete route. The as leg 
of a route between n cities is that arc (i,j) which is traversed between 
the a and (ae cities visited in sequence on the route. The route 
between ncities has (n-1) legs. 

As described in Section II, the algorithm generates a tree whose 
nodes represent subsets of routes. The notation for the nodes of the 
tree 1S: 

(i,j;k) is a subset of routes which have arc (i,j) for the ne 


leg, and 


(i,j:k) is the complement of (i, j:k). 
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Matrix reduction is the process of subtracting the minimum element 
in a matrix from each element in the matrix so that the least element in 
the reduced matrix is zero. The amount subtracted from each element is 
called the reducing constant. A set of matrices is called "reduced" if 
the least element in each matrix is zero. 

"Restriction" of the set of cost matrices is the process of deleting 
the matrices and arcs which are no longer possible for the subset of 
routes being considered. 

Arcs and legs are said to have been "committed" after they have 
been chosen to define a subset of possible routes. When (n-1) arcs 
have been committed to (n-1) legs, a route is completely determined. 


Other notation used in the algorithm is listed below. 


kK | | — th 
Ry rs) the matrix of costs of traversing arc (i,j) on the k 
leg of the route. 
AL la.) a matrix with elements that are the distances between 
pairs of nodes. 
Cy a multiplier (cost per unit distance) that is a function 
te cS 
of the k sequence position of a route. 
k 7 
g >. Ci summed over the set of (i,j;k) for committed 
arcs and legs. 
kK . . a 
My. (m,,) the current matrix of costs of traversing arc (i,j) on 
1) 


the ee leg of the route. Initially M,. = Ry but is 


changed by the operation of the algorithm. 


Tl 


M, the reduced form of M, 


a(i. ,j,;k) the reducing constant for M,- 


q (i yi 


*k) = ee ’ 
1 ) JJ 
x represents plus infinity as a matrix element. x is 
used as an element in a cost matrix to block the path 
between the associated node pair. 
W (Xx) the lower bound label attached to the tree for node X. 


O(i, J 7k) the second smallest element in M,- 


"k 
ie det kK = ma an ? 
B (i, iy ) ni ea 1 dns 


er ee = i> ark 
B(i ie KY) max, O(i, Ne ) 


Bs DETAILS OF THE BASIC ALGORITHM 

The algorithm, which is listed here in complete detail, uses the 
branch-and-bound technique to find the least cost route between n 
nodes when the matrix of costs changes for each leg in sequence on 
the route. It is assumed that the set of matrices Ry can be specified 
for all (n-1) legs of the route. The range of values for the elements 
of Ry is not restricted. 


A simplified flow chart of the algorithm is given in Section II] -B.2. 


Le The Steps of the Basic Algorithm 


Step 1 
The initial set up of the algorithm is made as 


follows. 


i SetM, =R, fork =1,2,...,n. 
is X is the set of all possible routes. 
oe Set Zo equal to plus infinity. Zo will be the 
cost of the optimal route at the end of the 
algorithm. 
Step 2 


ius Perecach k= 1.2....,n-l, find i , and 


kk 


_-. ee | k 
ati, sj) ik) such that q(iy 37k) min, min, mi ; 
2 Reduce M. to M. where aa = . - a(i. ,j. 3k) 
‘ k e i ij 0 | wee! 
torrall i; y7 Rk. 
a Label node X with W(X = > ali q(i pe 7k) summed 


Over k — 1,292. ,n-l. 


eee) o) 


Choose the subset for the next tree extension by the 


following procedure. 


k 
le noe ck = mine ae Decor ~ 
O (i, iy ) no J i Jy ms ior a GE Un 


committed legs. O(i iL: Meissimtinity if M, is 


a single element. 
2. 6 (i otk) = max, O(i, i, 7k) - 
3. Then y= @ 3 ;k ana Y= (i ,j_:k_) are the 
Ono Oo Ouse. O 
next branches from X. 
otep 4 


Label Y by W(Y) = W(X) + BL IGiK) : 
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step 9 


dligs Delete M 


IK 
O 
Ps a. Delete all elements in M,. al except row le 
O 
Joye D | ie : 
elete columns es and me in M, my 
O 
Sik: a. Delete all elements in M, rs except 
O 
column i 
O 
Iie Delete rows i andj inM : 
O O k - 1 
O 
ae Delete rows i. andj andcolumnsi= and j 
O O O O 


in all M, except fork =k - landk +l. 
Kk O O 


oe Relabel the matrices as M.. 


ie 
6. Leg KS and arc (ij) are now committed. 
otep 6 
i For each k, where leg k has not yet been 
itted t te, 11 ae i, eee 
committed to a route, find Dele and ali, iy ) 
a k 
such that q(ip J, ik) FL EEO 
' uk kK 
beg Red h = - ql aes 
educe M, to My, where ms mi ati si, ) 
for all i,j,k of uncommitted arcs. 
38 Label Y by W(Y) = W{X) + > q(iy J, ik) summed 


over k for uncommitted legs. 


step 7 


If (n-2) legs of the route have been committed go to 


otep 10. Otherwise go to Step 8. 


otep 8 


otep 9 


Select the node X from which to branch by 
choosing the terminal node which has the 
smallest label W(X). 

iba Z is less than or equal to W(X), the optimal 
route has been found. STOP. 


If X = Y of Step 6 go to Step 3. Otherwise 


go to Step 9. 


Set up the cost matrices and label node X as follows. 


ae 


tes 


otep 10 


Res is 
Compute g = past Summed over the set of 
(i,j;k) for committed arcs and legs. 
If no legs have been committed, set M. = Ry 


otherwise set M, = Ry 

Carry out substeps 1 through 5 of Step 95 for 
each of the committed arcs and legs. 

Block paths which are not allowed. 


Carry out Step 6 substeps 1 and 2. 


Label X with W(X) =g + ati, J ik) Summed over 
k for the uncommitted legs. 


Go to Step 3. 


fryvvivias less than Z Sea Z = W(Y). Go to Step 8. 


iS) 


Ly Flow Chart of the Basic Algorithm 


The flow chart of the basic algorithm is giver 





ae ros eae = ry 


page. 
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W (X) + sum of the 
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(N-2) legs been ~-_ 


committed 
?. 






Prcoucing Constants. ___ 


ee 


= -_ _— 
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ss 


oe EXPLANATION OF THE ALGORITHM BY EXAMPLE 

A simple numerical example will be used to illustrate the algorithm 
while tracing through the steps detailed in Section III. B.1. 

A Simple Sequence-Dependent Routing Problem 

Suppose an itinerant salesman must be routed so that his travel 
expenses are minimized while visiting 5 different cities. He must 
complete a leg of his route on each of 4 consecutive days. Travel ex- 
penses vary as a function of the day on which the travel occurs. At 
certain times no public transportation is available and the costs reflect 
the price of the available charter transportation. All possible costs 
have been tabulated for each of the 4 traveling days and are presented 
in Figure l. 


Step | 


The set of M, are the set of matrices of Figure l. 


Step 2 
The set of reducing constants is q({1,2;1) =3, q(2,3;2) =5, 
q(5,4;73) = 2, and q(4,5;4) =1. The set of My is reduced to the set of 
M, shown in Figure 2. W(X) =3 +5 +2+1= 11, which is the sum of 
the four reducing constants. 
Since the route must have four legs, it must as a minimum 


have a cost equal to the sum of the least elements in each of the four 


cost matrices. Therefore W(X) is indeed a valid lower bound. 
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= mp ne OF 


ee ee 2 se 5 3 4 gl 28 A 
meee Tl 4) Gee "G6 It 12 7 1X6 14 9 29 [x17 11 22 «9 
aeexe 7 Slswidge X 501013 |1g x 24 8 15128 x)16 19 lO 
ee? x 29 412694 x 15 1417 25 xX 3917 124 20° x82d™ 6 
Me AG MSN 18 920) X18) 5.1815) X 13 |15 14 12 X 1 
peters 20 26 =X} 9 16 23°29 X 26 Iz 23-2 «6X4 16°=7°13 «2X 


The initial set of cost matrices. 


Figure l 
yn MS ae say 
POLST 2 S80 CN 9 2S ee ee ee es Pe ee 
oe 0) SC | PaielenG 972.) x De eT iii Kolin 2 1a 
ae Xk poet Bo xX CS ele X22 oes 27 omeoum 
ome! oe omelet 19 xX 10 9, 5.23 xX, 1.15 23.19. X.20 5S 
oo et Tee 2 6 2 aa Ie) X 13,3 16 13 Jal ta aC llc Le ue (C 
Geo eee) 18 24x. 24.10 21. 0 X13 15 6 12 Xx 


Reduced matrices at the end of Step 2. 


Figure 2 

M, M, M, 
2 ee 
7 a a ey, 
ne) Xe ae x OMG 
3/20 lS a aS ae al 





Restricted set of matrices at the end of Step 5. 


Figure 3 


LR, 


step 3 


6 ( *k) = 1,1,1,5 fork = 1,2,3,4 respectively. Hence 


MeO 
Oli igikS) = 9(4,5:4) = 5 and the two subsets (4,5;4) and (4,5;4) are 
chosen for the next extension of the tree. 

Step 3 partitions X into subsets Y and Y by choosing the arc 
and leg on which to base the next branching. The object is to include 
in the route the arc and leg which is judged most likely to be on the 
optimal route. It is argued that one of the zero elements is a likely 
candidate to be on the optimal route; and that arc and leg are chosen 
which have mi equal zero and which, if not chosen, cause the greatest 


possible alternative cost. The arc and leg so chosen will raise the 


bound on Y the most. For each reduced matrix M. a @( 


‘ k) equal 


A ae 


to the second smallest element in the matrix is calculated. 6 k) = 


ee 


0 if My has two or more zero elements. The maximum over k of the 


6 ( ij. ;k) is the highest cost for not placing the zero cost arc on leg 


ues 


KS of the route. 


Step 4 


W(Y) = W(X) + 0(4,5;4) = 16. 


Step o 


The new restricted set of My is formed by eliminating arcs 


in the M, matrices which are not possible for subsets of routes in Y. 


Since the subset (4,5;4) was chosen, the restricted set of M) shown 


in Figure 3 are formed as follows. 


20 


We M,is deleted. 


4 
a A lggoni M, except column 4 is deleted, and Tig and 
Ve) 
Mey are also deleted. 
ce Rows and columns 4 and 5 are deleted from M, and M, : 


The restrictions brought about by the choice of arc (4,5) for 
leg 4 are now satisfied. Leg 3 must end at city 4 and no other legs are 
allowed to start or end at cities 4 and 5. It should be clear that if leg 
4 were not the last leg in the route, in accordance with the algorithm, 


leg 5 would be restricted to begin at city 5 and the restricted form of M. 


would have elements only in row 5. 


otep 6 


The set of q(i k) = 0,0,1 fork = 1,2,3 respectively. 


poe ag 
Hence W(Y) = W(X) + 1= 12. The restrictions introduced in Step 5 make 


it impossible to use the zero cost arc in the M. matrix at the end of 
Step 2. The lower bound is therefore tightened by the amount of the 
least element in the current M, . Figure 4 shows the set of reduced 
matrices and Figure 5 shows the labeled tree that has been constructed 
Upetouthis point. 

Step 7 

Only one leg has been committed, so Step 8 is next. 
Step 8 


Node (4,5;4) has the smallest lower bound and is chosen 


for the next X from which to branch. Z remains infinity. Since X is 


ak 


= 
= 
a 





] 2 3 
ez: 3 ete 4 
A, C0 s xX 1 6 6 
2:7xX 4 8 xX 0 9 
20 9x pe les)! QO 


Reduced matrices at the end 
oimStep 6. 





Figure 4 


Figure 9$ 


Figure 6 


iy 
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the same as the last Y, Step 3 is executed next. Step 9 is bypassed in 
this case since the correct set of M, is available from the end of Step 6. 
second Iteration 


Based on the set of matrices in Figure 4, O(i i ik )= 


——— 


O 
8(3,4;3) in Step 3 and the tree is extended to (3,4;3) and (3,4;3). In 


k 


— 


Step 4 W(Y) = 12 +5=17. After Step 6 the set of M_ is that of Figure 6. 
Since all the reducing constants are zero, (3,4;3) is labeled with W(X) + 
0=12. In Step 8 (3,4;3) is selected to be X and the third iteration begins 
with the execution of Step 3. 


Third Iteration 


isd 


In Step 3 Y is chosen to be (1,2;1) since Bi i, . 


Q@(1,2;1) =7. Therefore (1,2;1) is labeled with 19. After Step 5 only 
the single element for arc (2,3) in leg 2 remains. A complete route is 
now isolated since leg 2 with only one possible element must be included. 
After Step 6 the cost of leg 2 is incorporated in the label of (1,2;1) which 
is now also the total cost of the route. Steps 7 and 10 are executed so 
that Z = 12, the label on (1,2;1). Finally, since no terminal node has 
a label less than 12, the algorithm is stopped in Step 8. 

The optimal route is (1,2), (2,3), (3,4), (4,5) at a cost 
of 12. The completed tree for the problem is shown in Figure 7. Whereas 
complete enumeration would have required the calculation of the costs 


of 120 different possible combinations, branch-and-bound finds the 


optimal solution by calculating the complete cost of but a single route 
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and the lower bound on three other sets of routes. This clearly demon- 
strates the powerful potential for efficiency of the branch-and-bound 
technique. 

If the calculation of a label for a node in branch-and-bound is 
considered comparable to the evaluation of the recursive equation for 
one value of a state variable in dynamic programming, an approximate 
comparison of efficiencies between branch-and-bound and dynamic 
programming may be made. The dynamic programming solution to the 
problem just solved would have required evaluation of the recursive 
equation for 30 different values of the state variable and 30 comparisons 
to select the optimal route. The branch-and-bound solution requires 
the calculation of 7 node labels and 15 comparisons for both the select- 
ion of the X nodes from which to branch and the selection of the Y nodes 
for tree extension. Consequently, for this particular problem, the 


branch-and-bound algorithm is the more efficient solution procedure. 


18), A CONSTANT DISTANCE AND VARIABLE COST RATE (C,) PROBLEM 
A problem of some interest is the minimum cost route when the 
cost for each leg is the product of distance traveled and a sequence 
dependent cost factor. The branch-and-bound algorithm is used to 
solve this type of problem in the example below. 
A Constant Distance, Variable Cost Rate Example 


The optimal route passing through 6 cities is desired. The cost 


of travel between a given pair of cities is ca... c. is a function of the 
1} 


i k 
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es. 


day on which travel is performed and is called the daily cost rate. It is 
assumed that each leg of the route will be traversed on a different single 
day. Five days are required for travel. The cost rate (units of cost per 
unit distance) for each day is given in Figure 8 and the distance matrix 
in Figure <3 

The set of (n-1) cost matrices, where R, =c (a), is formed and 


k K 
shown in Figure 10. The set of reduced matrices M,, after Step 2 of 
the algorithm is shown in Figure ll. After the first iteration of the 
algorithm is completed through Step 6, the labeled tree is that shown 
in Figure 12. Since the bound on the left hand node is less than the 


bound on the right hand node, Step 9 of the algorithm is executed. 


Arc (2,5) is blocked for leg 5 by Setting ne 


25 to plus infinity. The set 


of matrices is reduced and shown in Figure 13. The sum of the reducing 
constants is found to be 20. Since g is zero (no arcs have been com- 
mitted in this subset), the label for the node is 20, which agrees with 
that determined on the first iteration for Y. 

The completed tree for this example is shown in Figure 14. Only 
one complete route is enumerated by the algorithm, the optimal route 
(2,5), ($3) - (6) (6,3), (8,4). Tt ie note eran. that four consecu- 
tive nodes in the left most branch of the tree have the same lower bound. 
Examination of the reduced matrices for (2,5;2) reveals the reason. 
pd tk) 


remain zero in later branches until sufficient arcs have become blocked 


Bi, J ik) in each matrix of Figure 15 is zero. All of the @(i 


to make at least one @(i *k) different from zcro. 
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The question arises of what branching rule to use when the values 


of 8(i ;k) are equal for two or more k. Of course, the best branching 


k ‘Ok! 
choice is that which causes as few other iterations as possible. But no 
rule that can be proved is known for making the choice. As shown in 


the tree, branching choices were made by taking zeroes in M, in the 
order in which they appeared in the matrix. Leg 5 was chosen because 


Ce was the highest cost rate multiplier and the route cost could be 


lessened by at least 5 units if one of the zero valued arcs in M, could 
be placed on the route. 

In any case no branching rule can eliminate the further branching 
required from (m-1) left hand nodes when m zeroes occur in a reduced 
matrix that is not symmetric. In Section III. E. the algorithm for the 
symmetric cost matrix case is discussed. 

The branch-and-bound algorithm required the calculation of 33 
labels and required the performance of 54 comparisons in order to choose 
Y nodes and 120 comparisons to find the X nodes from which to branch. 
For complete enumeration the cost of 720 different routes would be 
computed and compared. Dynamic programming would require 62 evalua- 
tions of the recursive equation and 62 comparisons to find the optimal 
route. The structure of the problem solved here causes numerous branches 
and increases the number of nodes that must be considered in the search 
for the next X node from which to branch further. Consequently for 
problems which generate numerous branches, branch-and-bound solu- 


tions may be inferior in efficiency to dynamic programming. 
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ts SYMMETRIC COST MATRICES 
dies Efficiency of Basic Algorithm for Symmetric Cost Matrices 

The basic algorithm presented in Section III. B. will succes- 
sfully solve the routing problem when all cost matrices are symmetric, 
but with poor efficiency. Symmetric cost matrices cause an increase in 
the number of branches because every reduced matrix will have two zero 
elements for the first iteration of the algorithm. The example in Section 
III. D. showed that multiple zeroes in the reduced cost matrices cause 
the branch-and-bound algorithm to be less efficient. A short example 
with symmetric cost matrices is given here to illustrate the difficulty 
inherent in symmetry for the basic algorithm. 

Figure 16 is the set of four symmetric cost matrices for 
which a minimal cost route is to be found. Figure 17 is the solution 
tree which results from the use of the basic algorithm presented in 
Section III. B. Twice in the leftmost branch of Figure 17, two branchings 
occur before the lower bound is raised. This double branching caused by 
Symmetry is avoided if a modification of the basic algorithm is used. 

ca Modification to the Algorithm for Symmetric Matrices 

In the modification of the algorithm, the arcs are considered 
undirected and the direction of the route is not specified until two adja- 
cent legs are committed. The nodes of the tree are redefined as (i Pons iae) 
with complementary node (i,j and j,i;k). The definition of a "directed" 


leg is necessary for the modified algorithm. 


Je 


Leg k is said to be "directed (i,j)" if leg k is committed and 
the only possible direction for the route in leg k is from i to j. 

Step 5A of the modified algorithm is used to specify direction 
for the set of directed legs. lf leg KA is already directed, Step 5 Omen 
basic algorithm is executed following Step 5B. Step 5 is more restrictive 
than Step 5C of the modification, in the sense that more matrix elements 
are deleted. Step 7 is changed in order that the direction of the last leg 
committed to the route can be determined. Step 9 is modified to account 
for the difference between "directed" and "undirected" legs. 

Because of symmetry only upper triangles of the cost matrices 
are used in the modified algorithm. This results in a reduction of storage 
required by the amount aa - 1)/2. 

The basic algorithm is modified for the symmetric cost matrices 
by inserting Step 5A, Step 5B, and Step 5C between Step 4 and Stepuaaam 
the basic algorithm and by making changes to Step 7 and Step 9. The 


details of the modification are given immediately below. 


otep oA 
l. If neither leg (kK, + 1) nor leg (k - 1) has been com- 


mitted go to Step 5C, otherwise, go to substep 2. 
2: Set t = Kou = ives = Ja: Execute the first of substeps 
3, 4, 5, and 6, which is applicable. 
can a. If leg (t + 1) has undirected arc (p,q) then 
(1) ifs =p, leg t is directed (u,s) and 


leg (t + 1) is directed (p,q). 
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2) ieee — 7 slegquiers directed (u,s) and 
leq ( tebieis directed (q,p) . 
(3) fu — pelea tire directed (s,u) and 


tic airected (p,q) . 


— 


leg 


q, leg t is directed (s,u) and 


(4) if u 
feq ti + 1) Ts cinecteama,D). 

Then if leg (t - 1) is committed and undirected, 

set t =t - 1 and execute substep 4 below. 

Otherwise go to Step 5B. 

eect!) 1s directed (p,q) and leg t has 

undirected arc (u,s) then 

(1) ifs =p, leg t is directed (u,s). 

(2) if We—peeleg £ is directed vsru) . 

If leg (t - 1) is committed and undirected, set 

t=t- 1 andrepeat substep 4. Otherwise go 


to Step 5B. 


If leg (t ~ 1) has undirected arc (p,q) then 


ay if s =p, leq t is directed (s,u) and 
lege eieis cairected (q,p). 
ay if s=q, leg t is directed (s,u) and 


leg (t ~ 1) is directed (p,q). 


(3) if u =p, leg t is directed (u,s) and 


leqeit— |) is directed (q,p). 


£5 


ls 
6. a 
lore 
step 5B 


(4) if u=q, leg t is directed (u,s) and 
leg (t - 1) is directed (p,q). 
If leg (t + 1) is committed and undirected, set 
t =t +1 and execute substep 6 below. Otherwise 
goutouSte penis 
If leg (t - 1) is directed (p,q) and leg t has 
undirected arc (u,s) then 
(1) if s=q, leg t is directed (s7u)e 


(2) ifn 


aupleoumiieedirectodminys). 
If leg (t + 1) is committed and undirected, set 


t=t+1 and repeat substep 6. Otherwise go to 


step oB. 


If leg kG is directed (p,q) as a result of Step 5A, the 


ordered pair for Step 5 is (Lod) = (p,q). Go to Step 5 in the basic 


algorithm. 


pLeD oC. 
l. 
Du 
oF. 


D 
elete M, 
O 


Delete all elements in M except rows i 
kt O 


andj . 

O 
k -l 
O 


Delete all elements in M except columns 


i *atide). 
O O 











uke A 
Delete m On ne wo whichever is present 
ome ly O 


in the upper triangle of the matrix, for k = a - | 
aia. =k 7 1. 
O 
Delete rows i andj andcolumnsi_ and j 
O O O O 


¥ +] and M, 1° 
O O 


in all matrices except M 
Relabel the matrices as M,- 


Leg KA and arc (igri) are now committed. 


Cesiovstep 6. 


Changes to Step 7 and Step 9 


i 


In Step 7 change "(n - 2)" to "(n - 1)". 
Replace substep 3 in Step 9 with 


"3. Carry out Step 5, substeps 1 through 5, 
for each of the directed legs and Step 5C, 
substeps 1 through 6, for each of the com- 
mitted but undirected legs." 


An Example Using the Algorithm Modified for Symmetric 
Cost Matrices 


Once again suppose a minimum cost route for the set of 


matrices in Figure 16 is to be found. 


First Iteration 


The set of reduced triangular M 


shown in Figure 18. 


\e at the end of Step 2 is 


Rive Lecmcunememns tale Gl 2° ug (2,332)y0oG lds o) 
and q(4,5:4) are equal to 3,5,3, and 1 respectively so that the label 


Cieieoutiesm mode or the tree is 12. 


a7 


In Step 3 BCi 7k) is found to be 6(4,5;4) which equals 3. 
In the modified algorithm the Y node for the next branch is chosen to be 
(4,5 or 5,4:4) and Y¥ is the complement (4,5 and 5,4;4) which is labeled 
by W(X) + 6(4,5;4) = 15 in Step 4. 

Since no legs have been committed yet in this first iteration, 
Step 5C is executed immediately following the first substep of Step 5A. 


M, is deleted. All the elements in M, except columns 4 and 5 are 


deleted. Columns and rows 4 and 5 are deleted in M, and M, . The set 


of matrices formed by restricting the set of M, are relabeled as the set 
of M, which are to be operated upon in Step 6 and which are shown in 
Figures (ss 

In Step 6 q(3,4;3) = 4 is the only non-zero reducing constant 
so that Y is labeled by 16. Since only one leg of the route has been 
committed, Step 8 follows Step 7. 

In Step 8 (4,5 and 5,4;4) is selected as the next node from 
which to branch. 

In Step 9 g = 0 since no legs have been committed in the 
subset being partitioned by node X. M, is set equal to Ry for allake 


Substep 3 requires no action since there are no committed arcs and legs. 


is set equal to infinity in order to block arc (4,5). The set of M,. is 


4 
45 
reduced by substep 5 and X is labeled by the sum of the reducing con- 
stants which equals 15. Step 3 which is executed next begins the second 


iteration. 
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Cost matrices at end of Step 5C of 
first iteration. 
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Reduced cost matrices at start of third iteration. 


Figure 20 
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oecond Iteration 

At the end of Step 6, Y = (3,4 or 4,3;4) has a label of 21 and 
Y as a result of Step 4 has a label of 20. In Step 8 (4,5 or 5,4;4) has the 
smallest label and is selected as the branch point for the next iteration. 


4 
In Step 9g = Tac = 1 since there is only the one committed 


leg. M is set equal to Ry for all k. Step 5C is carried out for the single 


committed but undirected leg 4 with arc (4,5). No paths need be blocked in 
in substep 4. After Step 9 is completed the set of cost matrices formed 
for the next iteration is given in Figure 20. This is the same set of 
matrices which would have been formed by reducing the set of matrices 
after Step 5C in the first iteration which are shown in Figure 19. 

Third Iteration 


Oi i ik ) = 6(1,2;1) = 4 in Step 3, so Y is (1,2 or 2,1;1). 


As a result of Step 4 Y is labeled by 20. 


Since leg 2 has not yet been committed, the direction of the 


route is still not determined, and Step 5C follows Step 5A. M, is 


deleted. Row 3 is deleted from M,. After being redesignated as M 


Z ie 


the new M, and M., are shown in Figure 21. 


In Step 6 all reducing constants are zero causing Y to be 
labeled by 16. In Step 8 Y becomes the chosen branch point for the 
next iteration. Step 9 is not required in the present iteration. 

Fourth Iteration 


O(i_,j_;k_) =90(3,4;3) in Steme3. Y is then (3/4 or 47 373)e 


6 0 G 


Y is labeled by 26 in Step 4. Only the direction (3,4) is compatible 
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Final solution tree with 
modified algorithm. 


Figure 22 


with the arcs specified for leg 4. Leg (kK + 1) is leg 4, which is com- 
mitted and undirected, so that substep 3.a is applicable. Therefore, 
leg 3 becomes directed (3,4) and leg 4 becomes directed (4,5). Step 5 
follows Step 5B. At the end of Step 6 only two elements in the single 
matrix M, remain, my» = 6 and ms 9 =Q. Consequently the reducing 
constant is zero and Y is labeled by 16. The next X for branching in 
Step 8 isagain the Y at the end of Step 6. 

Final Iteration 

The single zero element leads to i I GikS) equal to (2,373 
in Step 3. Yis labeled with 16 + 6 = 22 in Step 4. For Step 5A leg 
(Ko + 1) is leg 3 which is already directed so that substep 4.a is 
applicable and leg 2 becomes directed (2,3). Since leg 1 is undirected 
substep 4 is repeated, and leg 1 becomes directed (1,2). In Step 5 the 
last matrix is deleted. Since all legs have been committed, in Step 6 
Y retains the same label as X which is 16. (n - 1) legs of the route 
have now been assigned so that Step 10 follows Step 7. In Step 10 Zo 
is set equal to 16. In Step 8 zy is found to be less than or equal to 
the smallest label on any terminal node. Therefore, the optimal route 
has been isolated and the algorithm is terminated. 

The final solution tree is given in Figure 22. Only one 
connected path is contained in the nodes listed in the tree. The set of 
directed legs form the optimal route (1,2), (2,3), (3,4), (4,5). A com- 


parison of Figures 16 and 22 shows that three branchings in the leftmost 
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portion of the tree are eliminated by the use of the modified algorithm. 
For large problems the modified algorithm is expected to produce sig- 


nificant savings in storage and computer run time. 


Fe. ADDITIONAL APPLICATIONS 

Numerous applications may be constructed which specify arrival 
times, departure times, lay-overs, and other aspects of a routing 
problem. The following examples show that certain kinds of constraints 
can be quite easily entered into the algorithm. 

i A Constraint Specifying an Arrival Date for a Given City 

Suppose travel times vary because of transportation schedules 

and the objective is to minimize travel time with the additional con- 
Straint that the route must arrive at city m on the mo day of travel over 
the route. The constraint is easily entered by restricting RL to column 
k and R to row m, since arrival at city m must occur on leg k and 


te 


departure from city m must occur on leg (k + 1). 
tie A Constraint Specifying an Arc of the Route 
Suppose the objective is a minimum cost route with the 
COnmstraint that one leg will connect city pto city q. The constraint 
is entered by blocking all arcs from city p to cities other than q and 
blocking all arcs to g from other cities than p in all of the set of M,- 
S. A Minimum Weight-Distance Shipping Route Problem 
A domestic firm has ordered 8 units of heavy industrial equip- 


ment from a foreign manufacturer and desires to minimize the costs of 
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transporting these units to the plant sites that require them. The manu- 
facturer will deliver all the units to a single point of entry. The firm may 
choose any one of the plant sites as the point of entry without any addi- 
tional charges by the manufacturer. The firm must then use a special van 
to transport and install each of the units of equipment in each of the 
several plant sites. 

The cost of transportation of the units is proportional to the 
weight-distance hauled. In addition, a minimum cost per unit per day on 
board is incurred when the special van is not moved a minimum distance 
ina day. Each unit of equipment weighs the same. The number of units 


for each plant site is given below. 


Number of units Plant Number 
i] ] 
2 2 
1 3 
2 4 
] 5 
1 6 


The distance between sites is symmetric, so the transpor- 
tation costs per unit for haulage between sites is symmetric and is 
given in the triangular matrix in Figure 23. 

A unit can be installed on the same day that it arrives ata 
plant site. But no more than one unit can be installed ona single day, 
so that charges for a day of storage result for each additional unit 


installed at the same site. 
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The first unit is installed at the time of arrival of the entire 
shipment at the first plant site. Thereafter the costs are based on the 
number of units hauled or stored until the special van is empty. 

Site 2 and site 4 are made into two sites each so that the 
storage cost of 10 per unit per day may be entered into the cost matrix 
as shown in Figure 24. The problem is now in the form amenable to 
solution by the routing algorithm. A unit of equipment is installed on 
each leg of the route, and the cost for the leg is the product of one 
element from the cost-per-unit matrix times the number of units left at 
the beginning of that leg. Inthe notation of Section III. A. (c, ,c. jee 


2 


Cc.) = (7) 6,4... ey seaen Cy 


at the beginning of the pe leg. (a.,) is the cost matrix of Figure 24. 


ij 


R =c. (a.,) fork =1,2,..45/7* Sincereachn er ter 
k | ae, 


is the number of units yet to be installed 


k is symmetric, the 
algorithm as modified in Section III. E. may be used to find the sequence 
of deliveries of the equipment which minimizes the cost to the firm. 

4. Problems Including Both Cost and Profit 

Although only non-negative elements have been used in the 

cost matrices of the examples, negative costs are permitted; and, in 
fact, with the use of negative elements, negative labels may occur in 
the tree constructed by the algorithm. Consequently, net costs after 
subtracting profits for a given day's travel may be entered in the cost 
matrices. The algorithm is then used to produce the optimal net cost 


route which will have value less than zero if there is an overali net 


profit. 
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G. SPECIAL CASES SOLVED BETTER BY OTHER METHODS 
Ile Identical Cost Matrices for Each Leg 

Suppose the optimum route is desired where R = BS for all 
i,j. This problem may be more efficiently solved by converting it to a 
traveling salesman problem by injecting one more city, say city (n+ 1), 
and specifying that ar - el = Worl.) —"“le2aes. 2, l. [ne Tecomn— 
mendations of Ref. 1 may then be followed in finding an efficient way to 
solve the problem. The optimal traveling salesman route will contain 
the optimal route through the original n cities. The beginning and end 
of the optimal route desired are the cities which connect with the arti- 
ficial city that was injected to obtain a solution. 

une Cost Rate Constants Form a Monotonic Sequence 

If the optimal route is to be found from a set of (r matrices 
where a = Nee and if the set of Cy and the matrix (ao have special 
properties, the optimal route may be found very simply without recourse 
to this algorithm. 

If the set of Cy form a monotonically decreasing sequence for 
k=1,2,...,(n - 1), and if the shortest route using the distances in 
(a, Jis found to be a monotonically increasing sequence of arc lengths, 
the least cost route is the same as the shortest route of (a) . Further- 
more, the cost of the optimal route is the sum of the pairwise products 
of the elements taken in order from each of the two sequences. The same 


result is true if the directions of monotonicity were reversed for both 


sequences. 
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A theorem with respect to the minimum sum of pairwise 


products of the elements of an ascending and a descending sequence is 


presented in Ref. 9. 
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IV. DISCUSSION 


The sequence dependent route through n cities is closely akin to 
the traveling salesman problem. In fact if an additional leg were added 
to close the circuit back to the start of the route, the problem would be 
that of the traveling salesman with route costs changing after each arc 
is traversed. Consequently, the literature on the traveling salesman 
problem ~ in particular Little, et al [Ref. 1], the survey of the traveling 
salesman problem by Bellmore and Nemhauser [Ref. 2], and the survey 
of the branch-and-bound method by Lawler and Wood [Ref. 6] - contain 


much relevant comment. 


A. BRANCH -AND-BOUND COMPARED WITH DYNAMIC PROGRAMMING 
The number of computations, the storage space, and solution time 
required for the solution of the optimal route problem are exactly deter- 
mined by the number of elements in the cost matrices when dynamic 
programming is the solution method. These three factors are quite 
variable for the branch-and-bound method. All three depend on the 
number of nodes which must be generated in the tree to solve the problem. 
In many cases, such as the example in Section Ill. B. branch~and-bound 
is superior to dynamic programming in all three factors. Comparison 
for the traveling salesman problem in Ref. 2 shows that branch~and- 
bound provides lower average solution times with a much larger variance 


than similar problems solved by dynamic programming. For practical 


49 


purposes dynamic programming is restricted to the solution of routing 
problems with fewer than 15 nodes on the route. The storage requirements 
for the values of the recursive functions in dynamic programming for a 
15 node problem is 24,024 [Ref. 2]. For larger problems branch-and-bound 


methods prove superior by reducing the storage requirement. 


Be STRATEGIES OF BRANCHING 

The strategy used for the selection of the next branch point has a 
direct effect on the storage requirements for the branch-and-bound 
algorithm to solve the routing problem. The policy used in the flow chart 
is to branch from the lowest bound. This policy has the advantage of 
minimizing total computation, in the sense that any branching performed 
is also that which must be performed under any alternate policy. How- 
ever, under a "branch from the lowest bound" policy, no terminal nodes 
are discarded and the volume of storage may become excessive. The 
alternate strategy is to branch always from the newest active node and 
to discard nodes from storage that are out of the competition for the 
optimal route. Very few nodes are then kept in storage --- on the 
order of a few n [Ref. 1]. For this second strategy in the routing 
algorithm, branching would always be to the right until a complete route 
was enumerated or the bound exceeded the cost of a complete route 
already found. Then the process would work backwards up the branch 
until a left hand node with lower bound less than the cost of the completed 


route was found. The nodes that were passed by could be discarded from 
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storage and branching would be continuously to the right again from the 
selected node. This procedure saves storage but increases the number 
of computations and the solution time because many nodes are calculated 


unnecessarily when compared with the first strategy. 


c. SUBOPTIMIZATION 

A very useful feature of the branch-and-bound routing algorithm 
is that it allows accepting the solution and terminating the computation 
when a satisfactory suboptimization solution has been found. For in- 
stance, if the objective is to find a route that meets a budget constraint, 
the branch to the right strategy may be used, and the computation ends 
as soon as a Single route with cost less than the budget constraint has 
been found; or using the branch from the lowest bound policy, computa- 
tion ends when it is determined that no route less than the budget con- 
straint exists. In addition Ref. 6 gives branch-and-bound search 
procedures that are applicable to the routing algorithm for finding sub- 
optimal solutions that are within a given percentage of the optimal and 
also for finding the best suboptimal solution under a solution time 


Constrainr. 
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V. CONCLUSIONS 


The branch-and-bound algorithm can successfully find the optimal 
route for a variety of sequence dependent routing problems, including 
those with symmetric cost matrices, when the matrices of all possible 
costs for each leg of the route is known. On the basis of experience 
with the traveling salesman problem, the branch-and-bound routing 
algorithm is expected to be competitive with dynamic programming for 
routes involving fewer than 15 nodes and superior for larger problems. 
Under the branch-and-bound algorithm, storage requirements may be 
traded for increases in solution time and the number of computations. 
This trade-off is accomplished by the selection of the branching strategy 
used in the algorithm. Experience from digital computer runs is neces- 
sary to provide more quantitative recommendations for branching pro- 
cedures. Finally, only the branch-and-bound algorithm provides a 


rapid suboptimal solution when these are acceptable. 
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